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1 Introduction 



Complex networks play a crucial role in a wide range of practical systems of technological, 
biological, and social importance For example, the Internet, the World Wide Web 

(WWW) , communities of scientists and biological cells can all be described as complex net- 
works. Although various complex networks exist in various different fields, their evolutions 
are driven by a few rules. We believe that three intrinsic rules are behind the evolutions of 
most complex networks. They are randomness, adaptability and hereditary. The existing 
investigations usually focus on one or two of the three rules. 

The earliest study of complex networks can be traced to the investigation of regular 
graphs characterized by a large clustering coefficient and a long average path length. Erdos 
and Renyi 3 initiate the studies of complex networks as random graphs. They propose 
the ER model which has a short average path length and a small clustering coefficient. 
Later observations have found that some real networks have not only short average path 
lengths like random graphs but also large clustering coefficients like regular graphs. These 
two features characterize the small-world network. Watts and Strogats 0] later develop a 
model based on regular graphs in which links are random rewired with a fixed probability. 
For some range of small rewiring probabilities, their model successfully displays the small- 
world characteristics. Two things are common for random graphs and small-world networks: 
randomness of connections between nodes and exponential decay of the tail of the degree 
distribution. 

However, more recent empirical evidences from the Internet and WWW, among other 
complex networks, show a fundamentally different picture, i.e., the tail of the degree distri- 
bution follows a power law. Two general features have been observed in many real-world 
networks: successive additions of new nodes and preference to link to the existing nodes. 
This shows that randomness is not the unique feature of networks and leads to the introduc- 
tion of scale-free networks in 1999 by Albert, Barabadsi, and Jeong in their pioneering works 
[SJEIEIj which start a new phase in the study of complex networks. Albert, Barabadsi, and 
Jeong propose two mechanisms to characterize the evolution of a scale- free network jHJ[7]: 
the growth, starting from mo nodes, the network grows at a constant speed, i.e., adding 
one node at each time step and connecting to m (m < mo) existing nodes; the preferential 
attachment, the chance that an existing node receives a connection from a new node is 
proportional to the number of connections it already has. Here the phenomenon of pref- 
erential attachment reflects the adaptability of complex network. The authors show that, 
under these two mechanisms, a network evolves into a stationary scale-free state. Its degree 
distribution follows a power law with the degree exponent 7 = 2.9 ±0.1 from simulation 
analysis and 7 = 3 from the analytical result. These results are significant for complex 
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networks and these two mechanisms become the first model, referred to as the BA model. 
Although the BA model can be used to interpret many phenomena of complex networks, 
the degree exponent is a constant, which is a weakness since most empirical studies shows 
that 7 can be either less than 3 or large than 3 in real complex networks 1 . 

To improve the original BA model, many researchers suggest different mechanisms for 
both growth and preferential attachment under which the range of 7 varies from 2 to infinity. 
In the following, we will briefly review some significant works. 

Krapivsky, Redner, Leyvraz [S] examine the effect of a nonlinear preferential connection 
probability II(fc) on complex networks. By analyzing the rate equation, they demonstrate 
that the topology of the network is scale-free only when the preferential attachment is 
asymptotically linear. Dorogovtsev, Mendes, and Samukhin [S] use a master-equation ap- 
proach to study complex networks in which the probability II(fc) is proportional to the sum 
of a node's initial attractiveness and the number of incoming edges. By applying mean-field 
theory, Dorogovtsev and Mends JOj consider both preferential attachment and random re- 
moval (with equal probability) in the evolution of a network. Albert, Barabadsi 11 study 
internal edges and rewiring, Dorogovtsev and Mends |12| propose models for gradual aging. 

Different from the BA model, Krapivsky, Rodgers, Render JS| consider a growing net- 
work with directed edges. In their model, at each time step, either a new node or a new link 
is randomly added to the network and the attachment probability depends on the in- or 
out-degrees of nodes. By solving rate equations, they conclude that both in- and out-degree 
exponents lies in (2, 00). Kleinberg et al. ^J, Kumar et al. [151 llfij address an alternative 
preferential mechanism named copy mechanism by adding random links with "prototype" 
nodes. It is found that the copy mechanism is equivalent to a linear preferential attachment. 
Krapivsky and Render [17) 's edge redirection mechanisms is mathematically equivalent to 
Kumar et al.'s model discussed above. 

From the reviewed works, we find two common facts: (1) under linear growth, the range 
of the degree exponent can be extended to infinity by adding randomness into model; (2) 
local events and growth constraints have a similar function, which is to make the degree 
exponent vary between 2 and 3. Although the above research extends the range of the 
degree exponent, their proposed mechanisms are relatively complex. Compared with the 
above models, Liu et. al JHj's model is relatively simple. It combines the ideas from 
jH] and [H] to model the probability that a new node is connected to node i already in 
the network. They find that the degree exponent is no less than 3, so the model is not 
applicable to situations when the degree exponent is between 2 and 3, which is the most 
common range observed in real world. Recently, Chen and Shi |19[ introduces the concept 
of anti-preferential deletion into the BA model and show that 2 < 7 < 3. This shows that 
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integrating randomness and anti-preferential deletion into the BA model, one may construct 
a simple model for a general class of scale- free networks with 7 > 2. 

This research is mainly motivated by the above observation. Based on ^S] and |19|. 
we propose a simple evolution model of complex networks with preferential and random 
attachment, anti-preferential and random deletion. We show that the network self-organizes 
into a scale- free network. We obtain the expression of the degree exponent analytically, and 
find it lies in (2, 00). Clustering coefficient is another key network parameter, but analytical 
estimations are hard to obtain for growth networks as reflected by the current state of the 
literature. In this paper, we are able to derive an analytical expression for the clustering 
coefficient. Our method can be useful for similar studies. In short, our model is constructed 
from simple mechanisms and can be applied to analyze a general class of complex networks. 

We organize the paper as follows. In the next section, we present a simple model of scale- 
free network. In section 3, we obtain the degree exponent analytically. Section 4 develops 
a method to derive the clustering coefficient. Section 5 discusses the average path length. 
We conclude the paper in Section 6 by pointing out some future research opportunities. 



2 Model Description 

Our network starts with too completely connected nodes. At each time step, the following 
two procedures are performed: 

(i) A new node is added to the system: to(< Too) new edges from the new node are 
connected to to different existing nodes. A node i with degree fcj will receive a connection 
from the new node with the linear-preferential probability 

n(k .)- (1) 

where p is the probability that the selection of an existing node (for attachment) is random 
while (1 — p) is the probability that the selection of an existing node (for attachment) 
preferential. 

(ii) c old links are deleted: We first select node i with at least one link as one end of a 
link with the anti-linear-preferential probability 

n*(fc i ) = iv- 1 (*-i)[i-n(fc i )] ) (2) 

where N(t — 1) is the number of connected nodes with nonempty links at t time step and 
N^ 1 ^ — 1) is used as the normalized coefficient such that ^\ II* (fc;) = 1. Then, we choose 
another node j from the neighborhood of node i (denoted as Oi ) as the other end of the 
link with probability K^ 1 H*(kj), where Ki — YljeOi n*(fcj)- We delete the link connecting 
nodes i and j. We repeat this procedure c times to delete c old links. 
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The basic ideas of the above process is to use a linear combination of a random selection 
probability and a preferential selection probability as the selection probability. We believe 
that this linear selection rule for attachment and deletion models real world networks more 
closely, from the point of view of the evolutionary theory. 



3 Degree Distribution 

By the continuum theory, fcj(f) approximately satisfies the following dynamic equation: 



dt 



= mU(ki) — c 



n*(k)+ ^{k^KT^iki) 



= m n(h) - c n*(h) + n*(fc 4 ) ^ i^n* (%) 

jeOi 

(l-p)h+p 2 



for large t 



(3) 



[2(1 -p)(m-c)+p]t t 
where the last approximation comes from ~ P)kj + p] = [2(1 — p)(m — c) + p]t and 

{ir(fci) + n*(fci) J2jeo -^7 1 n*(%)} ~ 2/t. In the approximation, we assume that N(t - 
1) Kit and J2j e0 . KJ 1 I\*{kj) w 1. Near the end of next session, we give a simulation result 
to check the accuracy of degree exponent obtained under this assumption. 

Let ti be the time step when node i is added to the network. Initially node i has 
ki(U) = m links, thus the above equation has the following solution: 





h{t) = B 

where the dynamic exponent 

f3 = P(m,p, c) 

and the coefficient 

B = B(m,p, c) = Tu- 



rn, for large t 



i(l -p) 



2(1 - p)(m - c) + p 
rap — 2c[2(l — p)(m — c) + p] 



(4) 



(5) 



(6) 



to(1 — p) 

In the solution procedure, we require < (3 < 1 and B > for the feasible solution. To 
guarantee < (3 < 1, the parameters should satisfy 



(l-p)(m - 2c) +p > 0. 

On the other hand, the condition B > holds if and only if 

m 2 (l — p) + rap — 4c(l — p)(ra — c) — 2cp > 

(1 -p)(m - 2c) 2 +p(m - 2c) > 0^ 
(m - 2c)[(l - p)(m - 2c) + p] > 0. 



(7) 
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Therefore, we conclude that B > if only if J7J is held. In sum, we see that m > 2c is 
a sufficient condition for both < (3 < 1 and B > 0. 

Assume that follows the uniform distribution over interval (0,t). Then, by gj), we 
have 

p{Ht)<k) = i-(_JL_)V/j ' 



P(M) 



B — m + k mo + ^ ' 
clP(fc^) < fc) 

' 4 Bl/,3 ( fc + B - m r' 



m +t [3 



where 



P(fc) = ip^fe + B-m)- 7 , (t-^oo), (8) 
T _ 1+ '_ , + t^4. (9) 

p m(l — p) 

Thus, this system self-organizes into a scale-free network with a degree exponent given by 
©• 

Since [p — 2c(l — p)]/[m(l —p)] is increasing in p and 7 = 3 — 2c/m > 2 for p = 0, we have 
7 > 2. In particular, when p < 2c(l — p), we can generate values of 7 between 2 and 3. Such 
7 values have been observed in different networks including the WWW and movie actor 
collaboration networks .7, . For p — > 1, we have 7 — > 00 while for (1 — p)(m — 2c) + p — > 0, 
we obtain 7 — > 2. Further, when p = c = 0, it yields the BA model jSj; when p = and 
c > 0, it gives Model B (with n = 0) proposed by Chen and Shi ^Hj; when p > and c = 0, 
it is equivalent to the model studied in Liu et. al |18| . 

We now use simulation to compute the degree distribution of our model. We set too = 10, 
to = 5, c = 1 and p = 0.667. Analytically, 7 = 3 from J^} . In the experiment, we take the 
average from 100 runs. After computation, we obtain 7 « 2.996, and the coefficient is 29.692. 
Figurenshows that the results of the simulation, which indicates the approximations in J3J) 
are reasonable. 

Remark 1. Suppose that at each time step, we also perform an additional process: n new 
edges between old nodes are produced: a node i is selected as a end of a new edge, with the 
probability H(ki) given by (7)). Then, the new degree exponent is given by 

p- 2(1 -p)(n + c) 

1 = 3 + —, , w-i r~- ( 1U ) 

(to + Zn)(Y — p) 

We can show that this process has no impact on the range of^f. Further, by ififl)) . when 
we let c = 0, we find that the range of 7 is kept the same under the effect of n, which 
indicates that the function of adding new edges between old nodes is equivalent to that of 
anti-linear-preferential deletion. 



6 





Figure 1: the Degree Distribution 



Remark 2. Now, at each time step, we consider another additional operation: we rewire n 
existing edges in the network: select randomly a node i and a link Zy connected to it. Next 
we rewire this link and replace it with a new link l^j that connects node j and node i' chosen 
with the probability H(fci) given by £7J). This operation is repeated n times. As a result, the 
degree exponent is given by 

p - 2(1 - p)(n + c) 

7 = 3H ; ttt : — ■ (11) 

(m + n)(l-p) 

Clearly, n also does not affect the range of 7. Moreover, if we let c = 0, we see that 
the function of rewiring old edges between old nodes is equivalent to that of anti-linear- 
preferential deletion. 



4 Clustering Coefficient 

In this section, we present a method to derive an explicit expression for clustering 
coefficients of growing network models. 

Consider a node I. When the size of the network is N, there will be ki(N) nodes in 
its neighborhood. The maximum possible number of links among all the neighbors of node 
I is ki(N)[ki(N) — l]/2. The clustering coefficient Ci(N) of node I is then defined as the 
ratio between the actual number of links among all the nodes in the neighborhood and 
ki(N)[ki(N) — l]/2. The clustering coefficient of the network is then the average of the 
clustering coefficients of all the nodes in the network. 

To compute the clustering coefficient, we will rewrite dynamic equation in the fol- 
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lowing integral form 



/ m l - p)kj(j) + mp - 2cax 
ki(t)=m+ / ; dj, (12) 



where a\ = 2(1 — p)(m — c) + p > 0. 

From 1|12|) . we find that the expected number of links connecting node i added at the 
ith time step with node j added at the jth time epoch up to time step t is given by 

* m(l - p)ki(j) +mp- 2cai 

: dj. 

aij 

Next, by continuous theory, we obtain that the probability for the existence of a link 
from the node j to node i (i < j), i.e., 

ProbUij)} = m{l - P)hij) + mp - 2cai 

= ^V, (13) 
ait? 

where the second equality is followed from and 02 = m 2 (l — p) + mp — 2ca\ > 0. 

To find the number of actual connections among neighbors of a given node I, we need 
to consider the sequence (age) by which node / and its neighbors appear. For example, 
I < i < j means that node I is older than node i which is in turn older than node j. Then, 
the expected number of edges between node i and node j that are neighbors of node I is 
given by jf* dipili) J N djp(lj)p(ij). Similarly, we have to count five other cases: i < I < j, 
i<j<l,l<j<i, j < I < i and j < i < I. The related integration expressions of six cases 
are given in (|14(l . respectively. Note that we count the links between any two node twice, 
we need to divide the sum of six integrations by 2. Also, we approximate the maximum 
number of connections by ki(N) 2 /2. Thus, we obtain 

1 



Ci(N) 



k(N) 



dip(li) / djp(lj)p(ij) + / dip(il) / djp{lj)p(ij) 



l pi pN 

dip(il) / djp{jl)p{ij) + / dip(li) I djp(lj)p{ji) 



N 

dip(li) I djp(jl)p(ji) + I dip(il) I djp(jl)p(ji) 



(14) 

Now, we consider first two extreme cases of our model: /3 — 0.5 and f3 — 0. For 
(3 = 0.5, we set p = 0, c = 0. In this case, our model is equivalent to the BA model, and 
p{ij) = p(ji) = mlij)^ 1 / 2 /2. Furthermore, l|14|l can be simplified to 

J* dip(li) $ x djp(lj)p{ij) 



Q{N) 



h{N) 2 

= m(\nN) 2 /(8N) 

(In AH 2 , , 

oc { -^~. (15) 
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The last equation is the same as the one provided in . Noting that C; (N) is independent 
of I, Ijl5(l also gives the cluster coefficient of the whole network. 

When c = and p = 1, /3 = and we have a random network. We can rewrite l|13fl as 



Prob{(ij)} 
The integrations of ljl4Jl can be simplified, 



m 
j ' 



(16) 



N 



N 



dip(li) / djp(lj)p(ij) 



N 



dip(li) / djp(lj)p(ji) = m 3 (r 1 - iV _1 



IniV-InZ 
N 



JY 



N 



dip(il) j djp{lj)p{ij) = j dip(li) j djp(jl)p(ji) = m 3 — ^— (r 1 - iV^ 1 ), 



dip(il) J djp{jl)p(ij) = J dip(il) J djp(jl)p(ji) = ml 
Using ki (TV) « m In N as in .f5| , we can similarly obtain 
Q(N) = m 

= m 2(r 1 -N' 1 ) 
It is easy to see that 



I - 1 
I - 1 - In I 



rl _ N -i _ M-mi + i_i {rl N _ 1} + 



N ' I v " " ' ' Z 2 
InTV-InZ r 1 - iV" 1 Z-l-ln/ 



/(In TV) 5 



TV 



/ 2 



/(IniV) 5 



C(N) 



N 



Ci(N)dl/N oc 



1 



(17) 



NlnN 

The analytical results obtained above for random networks are new. 

For the general case, explicit formula for the clustering coefficient is more difficult to 
obtain. The following analysis provides a good general approximation. 

We need to compute the 6 integrations in l|14(l separately. For I < i < j, we have 



N 



N 



dip(li) / djp{lj)p(ij) = 



N „„,-P-i r N 



a 2 i 



HIP 



-di 



x —dj 



«i 



a\i>- 



N^-^lnN -\nl) N 2 ^ 1 - l 2 ^ 1 



2(3-1 



(2/3-1)2 



For i <l < j, 
el 



JY 



dip(il) / djp(lj)p(ij) = 



1 a^- 1 



l »i« 







di 



N aif- 1 a2f-\ . 

x —dj 



a 



lit 



3/-1 (1 _ r 2/3+l )jv 2/3-l _ pp-l + j 

of (2/3-1) 2 ' 



For i < j < I, 
rl 



dip(il) / djp(jl)p(ij) = 



1 ^"di ' 



all 2 ?- 



CL\l 

2 r 



a 2 (//i) /3 x ^m^ dj 



ail 



aij 



\nl I 



-2/3+1 



- 1 



2/3-1 (2/3 -l) 2 
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For / < j < i, 

r N 



dip(li) / djp(lj)p(ji) = 



N 



di 



a 2 f- 1 a 2 i^ 

X T, — 



2/3-1 



(2/3-1)2 



For j < I < i, 



II 



dip(li) / djp(Jl)p(ji) 



di 



a 2 i 



0-1 



-dj 



For j < i < I, 

r-l 



dip(il) / djp(jl)p(ji) 



,3j-l (1 _ r 2/3+l )jV 2/3-l _ + 1 

(2/3-1)2 

j* 3 - 1 r a 2 lP- 1 



«2 



1 ai«' 
all 2 ?- 2 



-di 



a 2 i 



1 ail 



iff 



a\J^ 



-dj 



1-2(3+1 _ 1 



InZ 



2/3-1 (2/3-1) 2 



Putting the summation together, we obtain the expectation number of actual connections 
among neighbors of a given node I: 



,a 2 , 3 f 7V 2 ' 3 - 1 [r 2 ' 3 (2/3 - l)(ln JV - InZ) - 2r 2 ' 3 + Z" 1 
£/ = ( — J 1 ■ 



a\ 



(18) 



a 



(2/3-1)2 

^-2 (2/3 _ 1)m/ + 3r l_ 2 ;2/3-2 

+ (2/3 -l) 2 

Substituting l(TH)l and h(N) 2 , noting J2J, into l(T3j l. we obtain 

q 2 f /V 2 ^ 1 [(2/3 - l)(ln/V - lnQ - 2 + Z 2 ^ 1 ] 
U ' ai I (2/3-l) 2 [SiV/ 3 -( J B-m)^] 2 

Z 4 ^ 2 (2/3 - 1) InZ + 3Z 2 ^ - 2Z 4 ^ 2 1 
+ (2/3-l) 2 [5A^ - (S-m)Z/ 3 ] 2 J ' ( ' 

Analytical integration of the above equation is next to impossible in general. For an 
approximation of the network clustering coefficient and to identify it asymptotic behavior 
as N becomes large, it is reasonable to approximate ki(N) by B(Nfl) 13 . This allows us to 
rewrite ifO^I as 



Q(N) 



q 2 3 iV^- 1 [(2/3-l)(ln/V-lnO-2 
[ a 1 ) S 2 (2/3- l)2/V2/3 



+ 



J2/J-1] + ;4/3-2 (2/3 _ !) ln/ + 3 pP-l _ 2^4/3-2 



B 2 (2f3-l) 2 N 2 f> 
Taking average on both sides of 1)20(1 . it is easy to conclude that 



(20) 



C(N) 



Ci(N)dl/N 



10 



B 2 (2f3-1) 2 \ L 2/3 4/3-1 (4/3 - 1) 2 4/3 - 1 J 

-^(2/3-3 + A )_ i v 2 ' 3 
2/3 

2/3-1 2 3 



+/V 2/3 (2/3 - 3 + - N 20 ~ 1 {2f3 - 3 + (2j9 - 1) InN + 



(4/3- l) 2 '4/3-1 2/3 J ' ^ 21 ) 
The above equation can be further simplified by keeping only the term with the highest 
order of N, i.e., we have 

C(N) oc /V 2/3 - 2 ln/V. (22) 

Obviously, we have 

lim C(N) oc lim N 2/3 ~ 2 \nN = 0. (23) 

JV^oo JV->oo 

Remark 3. Although the new model combines randomness and adaptability, the clustering 
coefficient is still quite small for a relatively large N. This shows that networks constructed 
with the two intrinsic rules do not exhibit the small world property, although it does exists 
in many real world scale-free networks. What are the reasons for this inconsistency? What 
is missing in our construction process? Our conjecture is that the third intrinsic evolution 
rule, i.e. hereditary, has been ignored in the model. 



5 Average Path Length 

We now examine the relationship between the average short path length L and the total 
number of nodes N in two experiments. For each experiment, we set too = 10, test the 
range of N from 10 3 to 10 4 , and take the average from 100 simulation runs. We then fit the 
data from the experiments by linear regression. 

Firstly, we examine the impact of m and p on L by comparing the following 5 cases, 
with a fix c = 0: 

Case I: m = 8, p = 0; 

Case II: to = 6, p — 0; 

Case III: to = 4, p = 0; 

Case IV: m = 4, p = 0.4; 

Case V: to = 4, p = 0.8. 

Comparing the first three cases, FigureEIshows that L is decreasing in m. This is because 
the connectivity degree increases with more newly added links. Figure [3] demonstrates how 
L changes with p in the last three cases. We find that L is increasing in p, which indicates 
that the randomness results in the long L. 

Secondly, we study the relationship between L and N under different values of the degree 
exponent 7. 
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Case IV: m = 4, p = 0.4, 7 = 3.167; 

Case VI: m = 5, c = 1 and p = 0.4, 7 = 2.667. 

In Figure 01 we observe that L in Case IV is a bit shorter than that in Case VI. The 
phenomenon shows that although a smaller 7 yields a larger probability that a node has 
more links, it is not the only factor that determines L. The length of L also depends on the 
network construction mechanism. 

Finally, noting that a log scale of the system size N is used, we can see in all three 
figures a logarithmic growth of L with respect to N. 



Case I 

. - - Case II 
Case III 



_ Q - -*'*■■ " 



3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 

iog I0 N 



Figure 2: Impact of m on L 



,o □" a n 



3.1 3.2 3.3 3.4 



3.5 3.6 3.7 3.8 3.9 

iog 10 N 



Figure 3: Impact of p on L 
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2.04 
2.035 
2.03 
2.025 
L 2.02 
2.015 
2.01 
2.005 
2 

3 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 

iog 10 N 

Figure 4: Impact of 7 on L 

6 Conclusions and Discussions 

There are two main contributions in this paper. First, by successfully integrating ran- 
domness and adaptability, we introduce a simple yet very flexible model for scale networks. 
While, as demonstrated in the previous sections, a number of the existing models are, in 
some way, special cases of our model, we are still able to derive an explicit expression for the 
network degree distribution. Our second contribution is the analytical expressions that we 
obtain for the clustering coefficient for a large class of scale-free networks. Apparently, there 
are not many successes in the literature for cluster coefficients due to analytical difficulties. 
Thus, the method we use in section 4 should be useful for others in the future. 

Our discussion of cluster coefficients leads to an important observation, i.e., Remark 3 
in section 4. Without hereditary, the important small world phenomenon displayed in real 
networks cannot be captured in our model as well as in many existing models. This shows 
much remain to be done in our quest to understand complex networks better. 

Some attempts have been made in including hereditary. Ravasz and Barabdsi [2^ build 
up a model of hierarchical organization with deterministic copy of a module. Dorogovtsev 
et al. [20| model scale-free networks by a deterministic pseudofractal graph. Although the 
authors show that the clustering coefficient of a node follows a power law with respect to 
the degree of the node, randomness and adaptability are absent. Sole et al. [221 investigate 
proteome growth model with random node duplications, old removal edges, and newly added 
edges. Empirically, they find by simulation that their model can explain the macroscopic 
features exhibited by the proteome. Klemm and Eguzluz |23| 's model combines the motif 
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copy and the BA model using a probability /i. For fi = 0, their model has the characters of 
small-world networks. For fi = 1, their model is equivalent to the BA model. But, due to 
the analytical difficulty for < fi < 1, the performance of the model can not be well studied. 
Holme and Kim |24| integrate preferential attachment with triad information to construct 
a scale-free network. By simulation, they show that their model can generate small-world 
characters. 
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